close
close
Your Network of Tomorrow
Your Network of Tomorrow
Plan your path toward a faster, more secure, and more resilient network designed for the applications and users that you support.
          Experience Netskope
          Get Hands-on With the Netskope Platform
          Here's your chance to experience the Netskope One single-cloud platform first-hand. Sign up for self-paced, hands-on labs, join us for monthly live product demos, take a free test drive of Netskope Private Access, or join us for a live, instructor-led workshops.
            A Leader in SSE. Now a Leader in Single-Vendor SASE.
            A Leader in SSE. Now a Leader in Single-Vendor SASE.
            Netskope debuts as a Leader in the Gartner® Magic Quadrant™ for Single-Vendor SASE
              Securing Generative AI for Dummies
              Securing Generative AI for Dummies
              Learn how your organization can balance the innovative potential of generative AI with robust data security practices.
                Modern data loss prevention (DLP) for Dummies eBook
                Modern Data Loss Prevention (DLP) for Dummies
                Get tips and tricks for transitioning to a cloud-delivered DLP.
                  Modern SD-WAN for SASE Dummies Book
                  Modern SD-WAN for SASE Dummies
                  Stop playing catch up with your networking architecture
                    Understanding where the risk lies
                    Advanced Analytics transforms the way security operations teams apply data-driven insights to implement better policies. With Advanced Analytics, you can identify trends, zero in on areas of concern and use the data to take action.
                        The 6 Most Compelling Use Cases for Complete Legacy VPN Replacement
                        The 6 Most Compelling Use Cases for Complete Legacy VPN Replacement
                        Netskope One Private Access is the only solution that allows you to retire your VPN for good.
                          Colgate-Palmolive Safeguards its "Intellectual Property” with Smart and Adaptable Data Protection
                          Colgate-Palmolive Safeguards its "Intellectual Property” with Smart and Adaptable Data Protection
                            Netskope GovCloud
                            Netskope achieves FedRAMP High Authorization
                            Choose Netskope GovCloud to accelerate your agency’s transformation.
                              Let's Do Great Things Together
                              Netskope’s partner-centric go-to-market strategy enables our partners to maximize their growth and profitability while transforming enterprise security.
                                Netskope solutions
                                Netskope Cloud Exchange
                                Netskope Cloud Exchange (CE) provides customers with powerful integration tools to leverage investments across their security posture.
                                  Netskope Technical Support
                                  Netskope Technical Support
                                  Our qualified support engineers are located worldwide and have diverse backgrounds in cloud security, networking, virtualization, content delivery, and software development, ensuring timely and quality technical assistance
                                    Netskope video
                                    Netskope Training
                                    Netskope training will help you become a cloud security expert. We are here to help you secure your digital transformation journey and make the most of your cloud, web, and private applications.

                                      An Overview of the Netskope AWS CloudTrail Lake Integration

                                      Jan 31 2023

                                      Following the recent AWS CloudTrail Lake announcement, this blog will guide you through how to configure a Netskope Cloud Exchange instance to send Netskope user access logs to AWS CloudTrail Lake using the Cloud Log Shipper (CLS) module and the CLS plugin developed for CloudTrail Lake. Cloud Exchange (deployed in Amazon ECS on Fargate) can be obtained from the AWS Marketplace.

                                      As a global cybersecurity leader, Netskope is redefining cloud, data, and network security to help organizations apply zero trust principles to protect data. Fast and easy to use, the Netskope platform provides optimized access and zero trust security for people, devices, and data anywhere they go. Netskope helps customers reduce risk, accelerate performance, and get unrivaled visibility into any cloud, web, and private application activity. Thousands of customers, including more than 25 of the Fortune 100, trust Netskope and its powerful NewEdge network to address evolving threats, new risks, technology shifts, organizational and network changes, and new regulatory requirements.

                                      Netskope has visibility into all customer traffic destined for the internet and generates user activity logs, including those related to Amazon Web Services. These logs possess invaluable information for AWS security admin, information that enriches AWS CloudTrail logs available out-of-the-box on AWS. This information includes details about the user, the owner of the AWS credentials in use, the resource they engaged with, the activity the user is engaged in, data objects they interacted with and the safety of those objects, and many other data points for over 300 different Amazon services and activity types.

                                      Here’s a closer look at how to configure this AWS CloudTrail Lake integration with Netskope Cloud Exchange:

                                      Figure 1: Architecture Diagram of Netskope Cloud Exchange Deployment

                                      Deployment Guide for Cloud Log Shipper Plugin for CloudTrail Lake v.0.0.1

                                      Customers will need to have deployed Netskope Cloud Exchange into their AWS environment (or into a similar container architecture). Customers can obtain CE for Amazon ECS here, or the docker-based code here if they prefer to install it into a pre-configured Linux host running on an AWS EC2 Instance.

                                      Prerequisites

                                      • The AWS account used must have access to the CloudTrail beta APIs.
                                      • Netskope Tenant (or multiple, for example, production and development/test instances)
                                      • Netskope Cloud Exchange: Log Shipper module
                                      • Connectivity to https://hub.docker.com (if CE is running outside of AWS)

                                      AWS: Creating a user with required permissions

                                      The user, or role that you use to work with to open audit events, must have permissions to call the PutAuditEvents API. Apply a policy with the following permissions to the role. This policy statement allows access to create, manage, and delete event data stores in CloudTrail Lake, run and view queries and results, and load open audit events into CloudTrail.

                                      {
                                      	"Version": "2012-10-17",
                                      	"Statement": [{
                                      			"Effect": "Allow",
                                      			"Action": [
                                      				"cloudtrail:CreateEventDataStore",
                                      				"cloudtrail:UpdateEventDataStore",
                                      				"cloudtrail:DeleteEventDataStore",
                                      				"cloudtrail:ListEventDataStores",
                                      				"cloudtrail:RestoreEventDataStore",
                                      				"cloudtrail:GetEventDataStore",
                                      				"cloudtrail:StartQuery",
                                      				"cloudtrail:ListQueries",
                                      				"cloudtrail:CancelQuery",
                                      				"cloudtrail:DescribeQuery",
                                      				"cloudtrail:GetQueryResults"
                                      			],
                                      			"Resource": "*"
                                      		},
                                      		{
                                      			"Effect": "Allow",
                                      			"Action": "cloudtrail-data:PutAuditEvents",
                                      			"Resource": "*"
                                      		},
                                      		{
                                      			"Effect": "Allow",
                                      			"Action": [
                                      				"iam:ListRoles",
                                      				"iam:GetRolePolicy",
                                      				"iam:GetUser"
                                      			],
                                      			"Resource": "*"
                                      		},
                                      		{
                                      			"Effect": "Allow",
                                      			"Action": [
                                      				"iam:PassRole"
                                      			],
                                      			"Resource": "*",
                                      			"Condition": {
                                      				"StringEquals": {
                                      					"iam:PassedToService": "cloudtrail.amazonaws.com"
                                      				}
                                      			}
                                      		}
                                      	]
                                      }
                                      

                                      AWS CloudTrail Lake: Creating an event data store

                                      You must have an event data store. If it does not already exist, you can create one by following the steps listed below.

                                      1. Log in to AWS console.
                                      2. Navigate to CloudTrail > Lake.
                                      3. Click  Event data stores.
                                      Figure 2: Creating a new event data store
                                      1. Click Create event data store and provide a data store name, and retention period.
                                      2. Click Next
                                      Figure 3: Setting up the event data store
                                      1. Choose the Type of the Events and choose the activities you want to log.
                                      2. Click Next.
                                      Figure 4: Enabling the data store to accept external data
                                      1. Click Create event data store
                                      Figure 5: Completing event data store setup
                                      1. Click Create event data store

                                      Using AWS CLI:

                                      1. Execute command replacing “my-event-data-store” with your event data store name:
                                      aws cloudtrail create-event-data-store \
                                       --name my-event-data-store \ 
                                       --retention-period 90 \
                                       --advanced-event-selectors '[ 
                                      { 
                                      "Name": "Select all open audit events", 
                                      "FieldSelectors": [ 
                                      { "Field": "eventCategory", "Equals": ["ActivityAuditLog"] } 
                                      ] 
                                      } 
                                      ]'

                                      AWS: Obtaining Access Key ID and Secret access key

                                      1. Login to AWS Console.
                                      2. Click on the username (top right corner) and navigate to Security Credentials.
                                      3. Click on Create access key.
                                      4. Make note of the Access Key ID and Secret access key.

                                      Netskope CLS: AWS CloudTrail Lake plugin configuration

                                      1. Log in to your CE instance.
                                      2. Navigate to Settings > Plugins.
                                      3. Click on the AWS CloudTrail Lake plugin tile.
                                      Figure 6: Adding the AWS CloudTrail Lake plugin in Cloud Exchange
                                      1. Fill out the form with these values:
                                        • Configuration Name: Unique name for the configuration.
                                        • Mapping: Select the valid Mapping. (Default Mapping for all plugins are available. If you want to Create New Mapping, follow the CLS guide to Create New Mapping.)
                                        • Use System Proxy: Enable if proxy is required for communication.
                                      Figure 7: Setting up Event Data Store
                                      1. Click on Next.
                                      2. Fill out the form with these values:
                                        • AWS Access Key ID (Public Key): AWS Access Key ID obtained previously.
                                        • AWS Secret Access Key (Private Key): AWS Secret Access Key obtained previously.
                                        • AWS Account ID: AWS Account ID obtained previously.
                                        • Region Name:Region Name.
                                      Figure 8: Plugin configuration in CE supports instantiation in multiple environments
                                      1. Click Save.
                                      Figure 9: Plugin configuration complete

                                      Validation

                                      From Netskope Cloud Exchange

                                      To validate proper connectivity and plugin function from within Netskope Cloud Exchange: 

                                      1. Navigate to Logging.
                                      2. Look for the “ingestion of X event logs into configuration CloudTrail success” as shown in the screenshot below.
                                      Figure 10: CE log of successful CloudTrail connection

                                      From AWS Console

                                      To validate proper connectivity and plugin function from within CloudTrail Lake.

                                      1. Login to AWS Console.
                                      2. Navigate to CloudTrail > Lake. Click on the Editor tab.
                                      3. Copy the Event data store ID.
                                      Figure 11: Event data store ID location
                                      1. Enter this query (replace <EVENT DATA STORE ID> previously copied ID and the datetime with your desired datetime; events created after this datetime will be shown) in the editor and click Run.
                                      SELECT eventData FROM <EVENT DATA STORE ID> WHERE eventtime >='2022-07-14 18:00:00'
                                      1. Scroll down to see the ingested events.
                                      Figure 12: View of logs sourced from Netskope via CE

                                      From AWS CLI

                                      To validate proper connectivity and plugin function from within the AWS CLI.

                                      1. Execute command aws cloudtrail list-event-data-stores to obtain the event data store ID.
                                      Figure 13: CLI page when finding event data store ID
                                      1. Copy the Event Data store ID from the above response.
                                      2. aws cloudtrail start-query –query-statement “SELECT eventData FROM <Event Data Store ID obtained in the previous step>”
                                      Figure 14: Query set up to show CE provided logs
                                      1. Copy the Query ID obtained from the previous response.
                                      2. aws cloudtrail get-query-results –event-data-store <Event ID> –query-id <Query ID>
                                      Figure 15: CLI output showing formatted logs from Netskope CE

                                      Next Steps

                                      Learn more about the recent AWS CloudTrail Lake announcement here. Cloud Exchange (deployed in Amazon ECS on Fargate) can be obtained from the AWS Marketplace.

                                      author image
                                      David Willis
                                      David is an experienced business, security, and technology leader with over 20 years across telecommunications, financial services, and software industry verticals.
                                      David is an experienced business, security, and technology leader with over 20 years across telecommunications, financial services, and software industry verticals.

                                      Stay informed!

                                      Subscribe for the latest from the Netskope Blog